In order to study the transport characteristics of air pollution in Linfen City, based on the hourly air quality index (AQI) data in Linfen City from the Ministry of Ecology and Environment from 2016 to 2017, the six-hour reanalysis data and the global data assimilation system (GDAS) data with a horizontal resolution of 1°×1° from the National Centers for Environmental Prediction (NCEP), the influence of topography and weather situation on air pollution during the 24 pollution processes in Linfen City was analyzed by using backward trajectory clustering analysis of HYSPLIT4 (hybrid single-particle lagrangian integrated trajectory) model. The results are as follows: (1) The sea-level circulation situation during the 24 pollution processes mainly included the following six types: front of Mongolian high pressure bottom type, front of low pressure type, rear of North China high pressure type, front of invert trough near the Hetao area type, uniform pressure field and low pressure belt type. (2) The 24 h and 60 h backward trajectory can represent the impact of topography conditions and weather conditions on pollution in Linfen City, respectively. (3) The 24 h backward trajectories show that the air flow can sink and transport pollutants along the leeward slope of the Lüliang Mountain. The pollution in Linfen City was formed from inverted “concave” shape terrain opening to the south and the southwest wind near the ground. The air flow can also return to Linfen City after touching the surrounding mountains. Among them, the transportation along the subsidence of the Lüliang Mountain from the northwest direction was main. (4) The 60 hour backward trajectories show that the air flow transporting pollutants met with the easterly or southerly airflow under the influence of the weather situation, and then turned back to Linfen City. The pollutant particles hygroscopic grew with the increase of humidity caused by southwesterly or easterly wind. The topography and weather situation have an impact on the transport route of air pollution in Linfen City.